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1. Introduction 

Real world problems often comprise several points of view that from a decision makers perspective have 
to be taken simultaneously into consideration. Multi-objective optimization approaches play in this context 
an increasingly important role, tackling applications in numerous areas. Due to the complexity of most 



Summary: The paper describes the proposition and application of a local search metaheuristic 
for multi-objective optimization problems. It is based on two main principles of heuristic search, 
intensification through variable neighborhoods, and diversification through perturbations and suc- 
^ ' cessive iterations in favorable regions of the search space. The concept is successfully tested on 

O . permutation flow shop scheduling problems under multiple objectives. While the obtained results 

are encouraging in terms of their quality, another positive attribute of the approach is its' simplic- 
ity as it does require the setting of only very few parameters. 
The implementation of the Pareto Iterated Local Search metaheuristic is based on the MOOPPS 
computer system of local search heuristics for multi-objective scheduling which has been 
awarded the European Academic Software Award 2002 in Ronneby, Sweden (http : //www . 
. easa-award . net /, http : //www . bth . se/llab/easa-2002 . nsf) . 
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problems however, problem resolution has to rely in many cases on modern heuristics that provide fast re- 
sults without necessarily identifying an optimal solution. Here, local search approaches like e. g. Simulated 
Annealing, Evolutionary Algorithms, and Tabu Search play a dominant role. Depending on the application 
area, more and more refined version and adaptations of local search metaheuristics have been proposed with 
increasing success in recent years. 

Scheduling is one of the most active areas of research, with applications in numerous areas of manufac- 
turing, computer systems/grid scheduling, sports/tournament scheduling, and airline/fleet scheduling, to 
mention a few. Many of the mentioned problems are of multi-criteria nature, and considerable effort has 
been made to solve these often AfV-hmd problems. While metaheuristics often lead to acceptable results, 
room for improvements can still be identified, especially as modern metaheuristics tend to require increas- 
ingly complex parameter settings. 

The current paper describes an local search heuristic for the effective resolution of multi-objective opti- 
mization problems, based on the local search paradigm. An application of the approach is presented to the 
multi-objective permutation flow shop scheduling problem. The article is organized as follows. Section 2 
first introduces the considered problem and briefly reviews heuristic solution approaches known from lit- 
erature. The Pareto Iterated Local Search algorithm is then presented in Section 3. An application of the 
metaheuristic to the discussed problem is given in the following Section 4, and conclusions are drawn in 
Section 5. 



2. Solving the Multi-Objective Permutation Flow Shop Scheduling Problem by Metaheuristics 



2.1. Problem Description 

The flow shop scheduling problem consists in the assignment of a set of jobs J = {J\, . . . J n }, each of 
which consists of a set of operations Jj = {Oji, . . . , Oj . } onto a set of machines M. = {Mi, . . . , M m } 
(Blazewicz, Ecker, Pesch, Schmidt and Weglarz, 2001; Pinedo, 2002). Each operation Ojk is processed 
by at most one machine at a time, involving a non-negative processing time pjk- The result of the problem 
resolution is a schedule x, defining for each operation Ojk a starting time Sjk on the corresponding machine. 
Several side constraints are present which have to be respected by any solution x belonging to the set of 
feasible schedules X. Precedence constraints Ojk > Ojk+iij = 1, • • • , n, k = 1, . . . , Oj — 1 between 
the operations of a job Jj assure that processing of Ojk+i only commences after completion of Ojk, thus 
Sjk+i ^ Sjk + Pjk- In flow shop scheduling, the machine sequence in which the operations are processed 
by the machines is identical for all jobs, and for the specific case of the permutation flow shop scheduling 
the job sequence must also be the same on all machines. 

The assignment of operations to machines has to be done with respect to one or several optimality criteria. 
Most optimality criteria are functions of the completion times Cj of the jobs Jj, with the computation as 
given in Expression (1). 

Cj =s j0j +p j0j (1) 

The most prominent is the maximum completion time (makespan) C max , computed in the following Ex- 
pression (2). 

Cmax — max Cj (2) 

Others express violations of due dates dj of jobs Jj. A due date dj defines a latest point of time until a 
job Jj should be finished as the assembled product has to be delivered to the customer on this date. The 
computation of an occurring tardiness Tj of a job Jj is given in Expression (3). A possible optimality 
criteria based on tardiness of jobs is e. g. the total tardiness T sum as given in Expression (4). 

Tj = max(Cj-dj,0) (3) 

T S um ^ ^ Tj (4) 

It is known, that for regular optimality criteria at least one active schedule x does exist which is also optimal 
(Baker, 1974). As the representation of an active schedule for the permutation flow shop scheduling problem 
is possible using a permutation of jobs tt = (m, . . . , n n ), where each Wj stores a job J k at position j, this 
way of representing alternatives is often used in resolution approaches. The search is then restricted to the 
much smaller set of active schedules only. 

Multi-objective approaches to scheduling consider a vector G(x) = (gi (x), . . . , gx (x) ) of optimality crite- 
ria at once (T'kindt and Billaut, 2002). As the relevant optimality criteria are often of conflicting nature, not 
a single solution x 6 X exists optimizing all components of G(x) at once. Optimality in multi-objective 
optimization problems is therefore understood in the sense of Pareto-optimality, and the resolution of multi- 
objective optimization problems lies in the identification of all elements belonging to the Pareto set P, 
containing all alternatives x which are not dominated by any other alternative x' 6 X. The corresponding 
definitions are given in Definition 1 and 2. Without loss of generality we assume the minimization of the 
optimality criteria gi(x)\/i = 1, . . . , K. 

Definition 1 (Dominance) A vector G(x),x e X is said to dominate a vector G(x') , x' e X ifandonlyif 
gi(x) ^ gi(x') A 3i | gi(x) < gi(x'). We denote the dominance of a G(x) over G(x') with G(x) < G(x'). 

Definition 2 (Pareto-optimality, Pareto set) An alternative x,x e X is called Pareto-optimal if and only 
if fix' E X | G(x') ^ G(x). The corresponding vector G(x) of a Pareto-optimal alternative is called 
efficient, the set of all Pareto-optimal alternatives is called the Pareto set P. 



After the identification of the Pareto set P, an interactive search might be performed by the decision maker 
(Vincke, 1992). The interactive procedure terminates with the identification of a most-preferred solution 

x* e P. 

2.2. Previous Research 

Several approaches of metaheuristics have been formulated and tested in order to solve the permutation flow 
shop scheduling problem under multiple, in most cases two, objectives. Common to all is the representation 
of solutions using permutations ir of jobs, as in previous investigation only regular functions are considered. 

First results have been obtained using Evolutionary Algorithms, which in general play a dominant role in 
the resolution of multi-objective optimization problems when using metaheuristics. This is mainly due to 
the fact that these methods incorporate the idea of a set of solutions, a so called population, as a general 
ingredient. Flow shop scheduling problems minimizing the maximum completion time and the average flow 
time have been solved by (Nagar, Heragu and Haddock, 1996). In their work, they however combine the two 
objectives into a weighted sum. Problems minimizing the maximum completion time and the total tardiness 
are solved by (Murata, Ishibuchi and Tanaka, 1996), again under the combination of both objectives into a 
weighted sum. Later work on the same problem class by (Basseur, Seynhaeve and Talbi, 2002) avoids the 
weighted sum approach, using dominance relations among the solutions only. 

Most recent work is presented by (Loukil, Teghem and Tuyttens, 2005). Contrary to approaches from 
Evolutionary Computations, the authors apply the Multi Objective Simulated Annealing approach MOSA 
(Ulungu, Teghem, Fortemps and Tuyttens, 1999) to a variety of bi-criterion scheduling problems. 

Flow shop scheduling problems with three objectives are studied by (Ishibuchi and Murata, 1998), and 
(Ishibuchi, Yoshida and Murata, 2003). The authors minimize the maximum completion time, the total 
completion time, and the maximum tardiness at once. A similar problem minimizing the maximum com- 
pletion time, the average flow time, and the average tardiness is then tackled by (Bagchi, 1999; Bagchi, 
2001). 



3. Pareto Iterated Local Search 

The Pareto Iterated Local Search (PILS) metaheuristic is a novel concept for the resolution of multi- 
objective optimization problems. It combines the two main driving forces of local search, intensification and 
diversification, into a single algorithm. The motivation behind the proposition of this concept can be seen 
in the increasing demand for simple, yet effective heuristics for the resolution of complex multi-objective 
optimization problems. Two developments in local search demonstrate the effectiveness of some intelligent 
ideas that make use of certain structures within the search space topology of problems. First, Iterated Local 
Search (Lourencp, Martin and Stiitzle, 2003), introducing the idea of perturbations to overcome local opti- 
mality and continue search in interesting areas of the search space. Second, Variable Neighborhood Search 
(Hansen and Mladenovic, 2003), combining multiple neighborhood operators into a single algorithm in 
order to avoid local optimality in the first place. In the proposed concept, both paradigms are combined and 
extended within a search framework handling not only a single but a set of alternatives at once. 

The main principle of the algorithm is sketched in Figure 1. Starting from an initial solution x\, an im- 
proving, intensifying search is performed until a set of locally optimal alternatives is identified, stored in a 
set p a PP rox representing the approximation of the true Pareto set P. No further improvements are possible 
from this point. In this initial step, a set of neighborhoods ensures that all identified alternatives are locally 
optimal not only to a single but to a set of neighborhoods. This principle, known from Variable Neighbor- 
hood Search, promises to lead to better results as it is known that all global optima are also locally optimal 
with respect to all possible neighborhoods while this is not necessarily the case for local optima. 

After the identification of a locally optimal set, a diversification step is performed on a solution X2 using a 
perturbation operator, continuing search from the perturbed solution £3. The perturbation operator has to 
be significantly different from the neighborhoods used in intensification, as otherwise the following search 



would return to the previous solution. On the other hand however, the perturbation should not entirely 
destroy the characteristics of the alternative. Doing that would result in a random restart of the search 
without keeping promising attributes of solutions. 
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Figure 1: Illustration of the Pareto Iterated Local Search metaheuristic. The archive of the currently best solutions is 
updated during the search. Here, G(xa) dominates G(x2) which is going to be deleted from p a PP rox , 

The PILS metaheuristic may be formalized as given in Algorithm 1 . The intensification of the algorithm, 
illustrated in the steps (1) and (3) of Figure 1 is within the lines 6 to 21, the description of the diversification, 
given in step (2) of Figure 1 is within the lines 22 to 26. 



Algorithm 1 Pareto Iterated Local Search 

1: Initialize control parameters: Define the neighborhoods Ni, . . . , Nfc 

2: Set i = 1 

3: Generate initial solution x 

4: Set P a PP r °* = { x } 

5: repeat 

6: repeat 

7: Compute Ni (x) 

8: Evaluate N^x) 

9: Update p a w™x with 

10: if 3a;' e Ni(x) \x' <x then 

11: Setx = x' 

12: Set i = 1 

13: Rearrange the neighborhoods Ni, . . . , in some random order 

14: else 

15: Seti = i+1 

16: end if 

17: until x locally optimal with respect to Ni, . . . , therefore i > k 

18: Set neighborhoods of x as 'investigated' 

19: Set i = 1 

20: if 3x' £ papprox | neighborhoods not investigated yet then 

21: Seta; = a;' 

22: else 

23: Select x' G P a w rox 

24: Compute x" = N perttlr f,(x') 

25: Set X = x" 

26: end if 

27: until termination criterion is met 



It can be seen, that the algorithm computes a set of neighborhoods for each alternative. The sequence in 
which the neighborhoods are computed is arranged in a random fashion, described in line 1 3 of Algorithm 1 . 
This introduces an additional element of diversity to the concept, as otherwise the search might be biased 
by a certain sequence of neighborhoods. 



4. An Application to Multi-Objective Flow Shop Scheduling 
4.1. Configuration of the Algorithm and Experimental Setup 

In the following, the Pareto Iterated Local Search is applied to a set of benchmark instances of the multi- 
objective permutation flow shop scheduling problem. They have been provided by (Basseur, Seynhaeve and 
Talbi, 2002), who first defined due dates for the well-known instances of (Taillard, 1993). The instances 
range from n = 20 jobs that have to be processed on m = 5 machines to n = 100, m = 20. All of them are 
solved under the simultaneous consideration of the minimization of the maximum completion time C max 
and the total tardiness T sum . 

Three operators are used in the definition of the neighborhoods Ni, . . . , described in the work of 
(Reeves, 1999). First, an exchange neighborhood, exchanging the position of two jobs in n, second, a 
forward shift neighborhood, taking a job from position i and reinserting it at position j with j < i, and 
finally a backward shift neighborhood, shifting a job from position i to j with j < i. All operators are 
problem independent, each computing "^" 2 ~ 1 ^ neighboring solutions. 

After a first approximation p a vP rox of the Pareto set is obtained, one element x' p a PP rox is selected by 
random and perturbed into another solution x" . We use a special neighborhood that on one hand leaves 
most of the characteristics of the perturbed alternatives intact, while still changes the positions of some 
jobs. Also, several consecutive applications of the neighborhoods Ni, . . . , are needed to return from 
x" back to x' . This is important, als otherwise the algorithm might navigate straight back to the initially 
perturbed alternative, possibly leading to a cycle in the search path. 

The perturbation neighborhood N pertMr ^ can be described as follows. First, a subset of 7r is randomly 
selected, comprising four consecutive jobs at positions j, j + 1, j + 2, j + 3. Then a neighboring solution 
is generated by moving the job at position j to j + 3, the one at position j + 1 to j + 2, the one at position 
j + 3 to j, and the job at position j + 3 to j + 2. In brief, this leads to a combination of several exchange 
and shift moves, executed at once. 

The benchmark instances of Basseur have been solved using the PILS algorithm. In each of the 100 test 
runs, the approximation quality of the obtained results has been analyzed using the D\ and D 2 metrics 
of (Czyzak and Jaszkiewicz, 1998). While for the smaller instances the optimal solutions are known, the 
analysis for the larger instances has to rely on the best known results published in the literature. Experiments 
have been carried out on a Intel Pentium IV processor, running at 1 .8 GHz. Table 1 gives an overview about 
the number of evaluations executed for each instance. Clearly, considerable more alternatives have to be 
evaluated with increasing size of the problem instances to allow a convergence of the algorithm. 

An implementation of the algorithm has been made available within the MOOPPS computer system, a 
software for the resolution of multi-objective scheduling problems using metaheuristics. The system is 
equipped with an extensive user interface that allows an interaction with a decision maker and is able to 
visualize the obtained results in alternative and outcome space. The system also allows the comparison of 
results obtained by different metaheuristics. For a first analysis, we compare the results obtained by PILS 
to the approximations of a multi-objective multi-operator search algorithm MOS, described in Algorithm 2. 

The MOS Algorithm is based on the concept of Variable Neighborhood Search, extending the general idea 
of several neighborhood operators by adding an archive p a PP rox towards the optimization of multi-objective 
problems. For a fair comparison, the same neighborhood operators are used as in the PILS algorithm. After 
the termination criterion is met in step 10, we restart search while keeping the approximation p a PP rox for 
the final analysis of the quality of the obtained solutions. 



Table 1: Number of evaluations for each investigated instance 



Instance n x m 


No of evaluations 


20 x 5 (#1) 


1,000,000 


20 x 5 (#2) 


1,000,000 


20 x 10 (#1) 


1,000,000 


20 x 10 (#2) 


1,000,000 


20 x 20 


1,000,000 


50 x 5 


5,000,000 


50 x 10 


5,000,000 


50 x 20 


5,000,000 


100 x 10 


10,000,000 


100 x 20 


10,000,000 



Algorithm 2 Multi-objective multi-operator search algorithm 

1: Generate initial solution x, set p a PP rox — { x } 

2: repeat 

3: Randomly select some x S p a PP rox | neighborhoods not investigated yet 

4: Randomly select some neighborhood Ni from Ni, . . . , Nj. 

5: Generate Ni (x) 

6: Update po-VVrox wkh N . (j.) 

7: if x e P a PP rox then 

8: Set neighborhoods of x as 'investigated' 

9: end if 

10: until ~fix e p a PP rox | neighborhoods not investigated yet 



4.2. Results 

The average values obtained by the investigated metaheuristics are given in Table 2. It can be seen, that PILS 
leads for all investigated problem instances to better results for both the Di and the D 2 metric. This general 
result is consistent independent from the actual problem instance. For a single instance, the 20 x 5 (#1), PILS 
was able to identify all optimal solutions in all test runs, leading to average values of Di = D 2 = 0.0000. 
Apparently, this instance is comparably easy to solve. 



Table 2: 


Average results of D\ 


and D2 






D 


1 


D 


2 


Instance n x m 


PILS 


MOS 


PILS 


MOS 


20 x 5 (#1) 


0.0000 


0.0323 


0.0000 


0.1258 


20 x 5 (#2) 


0.1106 


0.1372 


0.3667 


0.4249 


20 x 10 (#1) 


0.0016 


0.0199 


0.0146 


0.0598 


20 x 10 (#2) 


0.0011 


0.0254 


0.0145 


0.1078 


20 x 20 


0.0088 


0.0286 


0.0400 


0.1215 


50 x 5 


0.0069 


0.0622 


0.0204 


0.1119 


50 x 10 


0.0227 


0.3171 


0.0897 


0.4658 


50 x 20 


0.0191 


0.3966 


0.0616 


0.5609 


100 x 10 


0.0698 


0.3190 


0.1546 


0.4183 


100 x 20 


0.0013 


0.2349 


0.0255 


0.3814 



A deeper analysis has been performed to monitor the resolution behavior of the local search algorithms 
and to get a better understanding of how the algorithm converges towards the Pareto front. Figure 2 plots 
with x the results obtained by random sampling 50,000 alternatives for the problem instance 100 x 10, and 



compares the points obtained during the first intensification procedure of PILS until a locally optimal set is 
identified. The alternatives computed starting from a random initial solution towards the Pareto front are 
plotted as +, the Pareto front as 0. It can be seen, that in comparison to the initial solution even a simple 
local search approach converges in rather close proximity to the Pareto front. With increasing number of 
computations however, the steps towards the optimal solutions get increasingly smaller, as it can be seen 
when monitoring the distances between the + symbols. After convergence towards a locally optimal set, 
overcoming local optimality is then provided by means of the perturbation neighborhood N pertMr f,. 




Figure 2: Randomly generated solutions (x), intensification of search(+), and Pareto front (0) 

An interesting picture is obtained when analyzing the distribution of the randomly sampled 50,000 alterna- 
tives for instance 100 x 10. In Figure 3, the number of alternatives with a certain combination of objective 
function values are plotted and compared to the Pareto front, given in the left corner. It turns out that many 
alternatives are concentrated around some value combination in the area of approximately C max = 6900, 
T SU m = 111500, relatively far away from the Pareto front. 

When analyzing the convergence of local search heuristics toward the globally Pareto front as well as 
towards locally optimal alternatives, the question arises how many local search steps are necessary until 
a locally optimal alternative is identified. From a different point of view, this problem is discussed in 
the context of computational complexity of local search (Johnson, Papadimitriou and Yannakakis, 1988). 
It might be worth investigating this behavior in quantitative terms. Table 3 gives the average number of 
evaluations that have been necessary to reach a locally optimal alternative from some randomly generated 
initial solution. The analysis reveals that the computational effort grows exponentially with the number of 
jobs n. 



5. Conclusions 

In the past years, considerable progress has been made in the resolution of complex multi-objective op- 
timization problems. Effective metaheuristics have been developed, providing the possibility of comput- 
ing approximations to problems with numerous objectives and complex side constraints. While many ap- 
proaches are of increasingly effectiveness, complex parameter settings are however required to tune the 




Figure 3: Distribution of randomly generated solutions (+) compared to the Pareto front 0) 
Table 3: Number of evaluations until a locally optimal alternative is reached 



Instance n x m No of jobs No of evaluations 



20 x 5 (#1) 


20 


3.614 


20 x 5 (#2) 


20 


3.292 


20 x 10 (#1) 


20 


2.548 


20 x 10 (#2) 


20 


2.467 


20 x 20 


20 


2.657 


50 x 5 


50 


53.645 


50 x 10 


50 


55.647 


50 x 20 


50 


38.391 


100 x 10 


100 


793.968 


100 x 20 


100 


479.420 



solution approach to the given problem at hand. 

The algorithm presented in this paper proposed a metaheuristic, combining two recent principles of local 
search, Variable Neighborhood Search and Iterated Local Search. The main motivation behind the concept 
is the easy yet effective resolution of multi-objective optimization problems with an approach using only 
few parameters. 

After an initial introduction to the problem domain of flow shop scheduling under multiple objectives, the 
introduced PILS algorithm has been applied to a set of scheduling benchmark instances taken from litera- 
ture. We have been able to obtain encouraging results, despite the simplicity of the algorithmic approach. 
A comparison of the approximations of the Pareto sets has been given with a multi-operator local search 
approach, and as a conclusion PILS was able to lead to consistently better results. 

The presented approach seems to be a promising tool for the effective resolution of multi-objective opti- 
mization problems. After first tests on problems from the domain of scheduling, the resolution behavior on 



problems from other areas might be an interesting direction for further developments. 
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